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The use of linear programmed instruction (PI) as a teaching tool is 
of general importance to education. One of the basic assumptions of PI 
is that, for maximum learning, it is essential for the student to construct 
his responses as he progresses through the instructional program. Earlier ' 
research dealing with the question of the effects on achievement from PI 
of varying the response mode have not confirmed the hypothesized difference 
(Anderson, 1967; Tobias, 1968). Achievement was comparable if the S con*- 
• structed (overt), "thought" (covert), selected (multiple choice), or read 
his response. 

In a more recent review of the response mode issue in PI (Tobias, 1973b), 
the general lack of achievement differences was confirmed. However, an 
earlier suggestion (Tobias, 1969, Tobias & Abramson, 1971) that there was an 
interaction between response mode and the Ss prior familiarity with the ma** 
terial to be learned was reiterf^ted and expanded. It was hypothesized that 
overt responding would produce higher achievement if the material to be 
learned was new to the S and that there would be no difference in achievement 
between ^s exposed to different response modes for material with which the 
were already familiar. A plausible explanation for the failure of many 
studies to find superiority for the constructed response mode was that Ss were 
already familiar with the material to be learned before beginning their in- 
structional program. It appeared that when the response was already in S's 
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repertory there was no benefit in constructing the response^ but when the 
response was new to the S constructing the response lioproved performance. 

In examining the PI literature, no study was found which started with 
unfamiliar material , Induced a degree of familiarity In Ss prior to their 
exposure to the program, and then examined the effects on achievement re- 
sulting from different response modes • The present study deliberately 
manipulated Ss familiarity with the material la the attempt to establish 
the existence of such an ''attribute treatment interaction*' or ATI. Thus^ 
the major purpose of this research was to produce familiarity x treatment 
interactions for achievement from programmed instruction under controlled 
conditions. Furthermore, this study examined the effects of these inter- 
actions on achievement as measured oa an immediate and delayed post- test. 

The general hypothesis of this stiidy was that, for FX, an S*8 prior 
familii^^rity with the subject matter to be learned would ir^teract signifi- 
cantly with the response mode required of S. 

Specifically, for groups who were and were not familiarized with the 
subject matter: 

!• Constructed (overt) responses were not expected to result in dif- 
ferences in achievement » 

2. Silent reading (covert) responses were expected to lead to greater 
achievement by the familiarization group. 

3. Achievement for the familiarized covert group was expected to 
equal that of the overt response group. 

METHOD 

This investigation used a factorial design, with familiarity and re- 
sponse mode as the two independent variables. The effects of these vari- 
ables and the degree to which they interacted with sex was determined by 
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multiple linear regression techniques, as suggested by Cronbach and Snow 

(1969) • 

Subjects 

A total of 60 Ss, 30 of whom were female, was recruited from gradu- 
ate courses In educational research taught by the principal investigator 
at The City College of New York, ^s were asked to participate by the prln* 
dpal Investigator and were told that the rationale. Instrumentation, de** 
sign, etc., of the study would be used as illustrative material during the 
course. Experience (Tobias & Abramson, 1970) had shown that college and 
graduate students who participate in research studies of this type do not 
necessarily do so with the purest of motives. The belief that Ss were 
deeply engaged in the experimental task and were really attempting to learn 
the material was found to be an over-optimistic assumption. It was felt 
that incorporation of the study into the instructional procedures of the 
course would lead to more highly motivated Sa. The Ss who volunteered, 
not all the enrolled students did, were paid six dollars for their partici- 
pation and told that the experiment was designed to study the different 
ways people learn from programmed instruction. 
Materials 

The program used in this experiment consisted of a revised version of 
The Diagnosis of Myocardial Infraction (Mcchner, undated), and had been 
revised and employed in a series of investigations at The City College of 
New York (Tobias, 1968, 1969a, b; Tobias and Abramson, 1970, 1971). Only 
the 89 frames consisting of technical verbal and technical pictorial (EOG 
tracings) content which Ss were unlikely to have been exposed to previously, 
were included in this study. A full description of the program, program 
scoring, post-test, post-test scoring, reliabilities, etc., has been given 
elsewhere (Tobias, 1968). 



The program was presented in standard PI format » with the correct 
response to each frame given in the left margin of the following page, 
Ss were told to respond to each frame before turning the page to see the 
correct response. To insure that Ss could not see the answer through 
the page, a matter of some concern in earlier studies (Tobias and Abramson, 
1970), the back of the left margin of each page was printed with random 
black "squiggles." 

A separate reading version of the program which contained completed 
statements in each frame and did not; require overt respr.nses from the Ss 
was prepared for the reading condition. 

I'iaterials to familiarize the Ss with some of the technical vocabulary 
and EOG tracings were developed for this study (Abramson & Kagen, 1973). 
7ien technical terms and five tracings were selected from the program for 
this purpose and were given to the familiarization groups at the start of 
their first session. 
Procedures 

Two sessions were required to collect the data for this study. During 
the first session, Ss were given either the PI or reading version of the?, 
program which was immediately followed by a. post- test. One week later the 
same post- test waa readministered. 

The Ss were randomly assigned to the familiarization (F) or the non- 
familiarization (NF) condition. Half of the F and NF Js wisre randomly as- 
signed to the constructed response (CR) and half to the reading (R) con- 
dition. Thus there were 15 Ss under each of the following conditions: 
familiarization - consturcted response (FCR), fami?ciarization - reading (FR) , 
non- familiarization - constructed response (NFCR) , non- familiarization - 
reading (NFR). One female in the FCR group was dropped because she did not 
return for the delayed post-test. 



The Ss In the F condition were given the familiarization material be- 
fore the program* They were given four minutes to copy a list of 10 vocabu- 
lary words twice and to memorize the list. No definition of the terms were 
given* They were then given two minutes to reproduce the list from memory. 
The ^8 were then asked to study and match two groups of five tracings and 
to draw a copy of each tracing* Two minutes were allowed for these tracing 
tasks. Following these tasks the program was administered. 

The experiment was conducted with CR and R groups in separate rooms 
since the CR program generally takes longer than the R program and it was 
essen,tl£il that the CR Ss not be disturbed by the Ss in the R condition com- 
pleting th<^ilr tasks and leaving earlier. As each S completed his program, 
his work time was recorded and the post-test was given to the Sj when S 
finished his test the time was again recorded and S was dismissed. Approx- 
imately one week later ^s were given the same post-test with each individual • 
time recorded. 



Results 



The critical mea^res in this investigation were the scores attained 
on the post-test (PT) and the delayed post- test (DPT). The scores on the 
tracing and the verbal sections were considered separately, yielding a total 
of four criterion measures. 

The data were analyzed using multiple linear regression techniques, 
as outlined by Kelly, et. al. (1969). A subject's group membership was 
represented as a 0 for the CR group and a 1 for the R group. Similarly, 
the F group was coded as a 0 and the NF group as a 1. Interaction vectors 
between the experimental variables were the simple products of the compo* 
nent vectors. A preliminary analysis (1 way ANOVA) indicated that there 
was differential sex effect (F = 4.73, p -<.05) on the FT tracing data. 
Therefore, a binary sex vector was added to the analysis with males coded 
C and females coded 1. The full model for the analysis of the achieve- 
ment data thu3 included the three main variables of response mode, famil- 
iarization, and sex and the four intersections between them. 

The analysis followed a stepdown procedure which started with the 
full model and tested for the significance of any variable or interaction 
of Interest incliided in the full model. The test was conducted by forming 
a reduced model through the removal of the component of interest and then 
testing for the reduction in the resulting multiple correlation. This 
procedure allowed for the estimation of the percentage of variance contri- 
buted independently by any variable adjusted for the effects of all other 
variables. 

^Beta weights, regression coefficients, and other data pertaining to 
the full models can be found in Abramson & Kagen, 1973. 
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Table 1 Indicates that none of the main effects were consistently sig- 
Insert Table 1 about here 



nificant. Sex had a differential effect in favor of the males only on the 
FT tracing score (F = 5.54). Response mcds and familiarization showed dif- 
ferential effects on the DPT tracing score (F « 4.87; F « 7.85, respectively), 
with the CR and the P groups scoring highest. These differences for only 
some but not all, the criterion scores parallel the inconclusive findings of 
the earlier .studies that prompted this investigation. 

On the other hand. Table 1 clearly supports the main hypothesis of this 
study that response mode would interact with prior familiarity. On three of 
the four criterion measures (FT tracing, DPT tracing, DPT verbal) there was a 
significant response mode x familiarization interaction, and the interaction 
approached significance on the fourth criterion (FT verbal). On the PT and 
DPT verbal scores there was also a significant response mode x familiariza- 
tion X. sex interaction. Following the suggestions of Berlin and Cahen (1973) 
for ATI studies, the interaction data are presented in both tables and fig- 
ures. 

Table 2 shows that means and SD s for each group on the four criteria. 
Insert Table 2 about here 



There was a significant response mode x familiarization interaction on the PT 
tracing and the DPT tracing. Figure 1 is a representation of the Interactions 



Insert Figure 1 about here 



resulting from the plotting of the means of the FT and DPT tracing scores. 
Clearly, familiarization affected the two response mode conditions differently. 
On the FT, prior familiarization resulted in a relatively high criterion mean 
for the Ss in the reading condition. For the CR group, familiarization led 
to a criterion mean ^ little lower than under the no familiarization condi- 
tion. Ou the tracing retention measure, the DPI, prior familiarization had 
relatively as strong a beneficial effect on the R group as it had a detri* 
mental effect on the CR group. 

There were significant triple interactions on the FT and DFT verbal cri- 



Insert Table 3 about here 



terlon. Table 3 shows the means and SDs for the groups according to sex, and 
Figures 2 and 3 are pictorial representations of these data. For both males 



Insert Figures 2 and 3 about here 

and females there was a response mode x familiarization interaction, but the 
interaction was different for each sex. The Interaction for the males on the 
rr verbal criterion (see Fig. 2) was comparable to thiat generally found on the 
tracing data. Namely, familiarization led to Increased achievement for the R 
group and to lower achievement for the CR group. There was an ordinal inter- 
action for the females on the FT verbal score with the CR group higher than 
the R group under both F and NF conditions « On this criterion there w*ns a sig- 
nificant increase in achievement under the F condition for the CR females. 

The DFT verbal data diagrammed in Figure 3 exhibit an interaction compar- 
able to that shown on the FT verbal scores, but the differential effects on 
the DFT of familiarization are more pronounced in the R group than on the FT 
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verbal scores • The male NFR group performed more poorly than any other 
group while the male FR group had the highest achievement. The female CR 
groups exhibit the same effects of familiarization as on the FT verbal score, 
but here the UFR group scored higher than the NFCR group, producing the 
typical disordinal interaction shown In the other data (see figures 1 and 2). 

An ANOVA was performed on the amount of time spent on the program and on 
each of the criterion tests. These data are shown in Table 4, The analysis 
on program time showed an anticipated huge main effect for response mode 



Insert Table 4 about here 



(F n 333.17) • Inspection of the data indicates that this was due to the 
relatively long time it takes to complete the CR program. The same analysis 
for the FT time showed another large effect for response mode (F = 49.00) 
with the CR group taking about half the time the R group spent on the test. 
This large effect disappeared on the DPT where thc^re was virtually no dif- 
ference between the groups* 

Data for the percentage. of correct responses to the program were avail- 
able only for the two CR groups. These data, analyzed ia the same manner as 
the achievement data, yielded no significant differences between the F and 
the NF groups for either the tracing or the verbal portions for the program. 
Both groups had 70-80% correct responses on the program. 

The familiarization material for the two familiarization groups was also 
scored. Ss scored better than 80% correct, implying that ^s did attempt to 
learn the familiarization material. 
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Dlscusslon 



ATI 

The results of this experiment clearly support the notion of an ATI 
between prior familiarity with material and response mode for achievement 
from programmed instruction. The finding that constructing response leads 
to superior achievement compared to achievement from a reading mode when 
the material is unfamiliar replicates previous findings (Tobias, 1969a, b: 
Tobias & Abramson, 1970), and provides strong experimental support for the 
position recently taken by Tobias (i973a) with regard to the familiarity in- 
terpretation. The hypothesized. ATI was found for both verbal and tracing 
tasks but occured most clearly on the tracing material. As expected, famil* 
larizing Ss with aspects of the tracing material prior to their exposure to 
the program led to superior achievement when the learning program followed a 
reading mode. However, the same familiarization led to lower achievement 
when the constructed response mode constituted the format of the program--an 
unexpected result as the hypothesis was for no difference between familiar- 
ized and unfamiliarized groups on the constructed response mode of the pro- 
gram. 

The nature of the ATI was more complicate:? on the verbal material where 
there was a sex x familiarity x response mode triple interaction. Among 
males, the ATI had the same general form on the verbal material as the com- 
bined male and female group showed on the tracing material. That is, fam- 
iliarization led to improved performance on the verbal material for the 
reading mode Ss and lower achievement for the constructed response Ss. 
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The females had an opposite ATI. Familiarization led to higher achievement 
from the constructed response mcde and lower achievement for the reading 
mode. The comparatively high scores achieved by the females in the non- 
famlllari^ed reading condition on the DPT (see Table 3) may have been due to 
the nature of the Ss in that group rather than the treatment since the ex- 
pected drop in achievement on the delayed test, administered one week later, 
was exhibited by every group except the female non-familiar reading group. 
Response Mode 

It had been hypothesized that familiarization would not affect achieve- 
ment from the constructed response mode groups. A possible explantion for 
the unexpected finding that familiarization led to lower achievement from 
a constructed response mode th^^n did non- familiarization follows a motiva- 
tion-attention argument. For the graduate students it became counterpro- 
ductive to elicit an overt response to ever^ frame after previously famf>l^ 
iarizing Ss with the material to be learned from the program. Thestt rela- 
tively superior learners might have become bored with the learning program 
when they were forced to respond to each frame whether or not they already 
knew the correct answer. This is particularly so in view of the inherent 
redundancy built into most linear programs. Thus, it was thought that the 
familiarized group was not as attentive as the non- familiarized group and 
thus did not learn as much. 
Sex 

The sex difference in the direction of the constructed .response x fa- 
miliarization ATI at the college level was somewhat puzzling but may be 
understood (or perhaps explained away) in terms of the familiarity hypothesis 
and Maccoby's (1972) male- impulsive and female-passive model of cognitive 
differences between the sexes. 

The biographical questionnaires indicated that there were eight male 



and nine female science Toajors in the sample, However » In general » females 
In our culture have less exposure to and Interest In technical-scientific 
subject matter than do males. The type of subject matter of this, experiment » 
myocarlal Infarction and Its dlagnbsls (including analysis and reproduction 
of EOG tracings) 9 was f:herefore probably more familiar^ interesting^ or 
challenging to the males* Thus^ the males may have known some of the Infor- 
mationy even if, not necessarily the exact responses required by the program. 
The pre- familiarization may have taught the females Just enough to increase 
their knowledge to the level o£ the' response repertoire of the non- familiarized 
males. The. females being more passive than their male counterparts did not 
get ''turned off^' and continued to attend to the program until they completed 
their tasks » whereas the CR males might not have attended to the entire pro- 
gram* Thus» the constructed response pre- familiarized females » starting from 
the same knowledge level as the noa-pre- familiarized males^ achieved as well 
as the males who were given ^he constructed response program without pre^ 
familiarization. Because the non-pre- familiarized females started at a know- 
ledge level lower than thler male counterparts » they ended up at a lower 
achievement level. 
Delayed Post- test 

An Interesting finding of this study was that the relative differences 
in the amount of learning as measured on the immediate post-test became more 
pronounced on the retention test. The interactions on immediate learning 
accounted for TU and 5% of the variance while on the retention test^ adminis- 
tered oae week later, the interactions accounted for 217. and 127* of the vari- 
ance. The sharpening of achievement differences on the retention test is 
cmslstent with Ausubel's theory of meaningful learning (Ausubel, 1968), 
Ausubel proposed one mechanism^ assimilation^ to account for both learning 
and forgetting and concluded that retention was a direct effect of initial 
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learning. He stated that the most Important fact>or for learning and con- 
sequently for retention. Is the prior presence of clear, s^able» relevant 
Ideas to act as "anchors" for the new material. Ausubel suggested that ad* 
vance organizers should therefore be provided. The familiarizing material 
in this study may have acted as an organizer, providing the necessary anchors 
and allowing the material to be more completely incorporated Into the 
learner's cognitive structure* The data from thlb utudy, showing that the 
differences in performance Increased during the retention Interval support 
this theoretical position. There was a differential rate of forgetting; ^s 
who learned more initially forgot at s slower rate than Ss who did not in- 
itially learn as much. 
Time 

In accord with the findings of other Investigations, present results 
indicated that constructed response groups required significantly more time 
than the reading groups to cover the same material. A basic discussion of 
the efficiency issue has been given in an earlier study (Tobias & Abram^on, 
1970) and will not be repeated here. The important result, as pointed out 
above, was that the longer period of time and forced responding seemed to 
have adverse effects on achievement for Ss who vere both good learners and 
familiar with the subject matter. The post-test time data support the "at- 
tention" Interpretation of this finding. Ss who had the constructed response 
program, which required triple the time of the reading pro^^rara, took about 
one-half the time to complete the post- test as compared to Ss who had the 
reading program. This test time difference did not result in differences 
in achievement since the high scoring constructed response group required the 
same amount of time at the low scoring group. Similarly, the reading groups 
required the same amount of time whether they scored high or low. It appears 
that Ss whose learning task took a long time (over an hour) raced through 
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their test in order to finish their assignment. When the delayed test was 
administered, all the groups) took equal time, indicating that the differen- 
tial effect on the post* test time was probably due to the prograa*that was 
given ixxnediately preceding the test. 
Implications and Conclusion 

Although the present results clearly support a facdliarization x re* 
sponse mode interaction, the data do not permit a clear and consistent 
theoretical interpretation of these interactions. However, the results of 
the study have Implications for instructional methodology. College level 
females who are to learn technical unfamiliar material similar to that en* 
ployed in this study from FX should first be provided some farelllarlzlng 
material and then given the complete program requiring constructed responses. 
On the other hand, the optlmnm strategy for college level males requires 
the Instructor cither to implement a constructed response program without 
prior familiarization or to provide familiarising material follov«d by a 
reading program. The latter option would require less time and chus In- 
crease available Instructional time, if the students are mir^mdy familiar 
with the Material then a reading program would be nost beneficial. lo ary 
event, ftracht (1970) not^lthstandlni, this study prwlde* data o^ iht ex- 
istence of ATI's, and their effects on achtevement from prograsmed Instruc- 
tion. 
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TABLE I 



Multiple Linea..- Regression Analysis of Achievement Data 
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.07 




.02 
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clon (B) 1 


.04 
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.02 


1.51 


.11 


** 

7.85 






Sex (C) 1 
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5. 54 
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A X B 1 
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.02 


i.65 
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2.46 
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.09 


5.31* 






.14 


9.23 



• £ values las 

* £ < .05 

** 2 < 
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TABLE 2 

Means and Standard Deviations on the Verbal 
and Tracing PostCest and Delayed PosCtest 
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Delayed 


Posttest 








Verbal 


Tracing 


Verbal 


Tracing 


Croup 


N 




SD 


V 


SD 




SD 




SD 
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30.43 


7.59 


22.29 


8.43 


25.50 


5.60 


14.11 


7.33 


NFCR 


15 
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11.18 



2G- 



TABLB 3 



Means and Standard Deviations for the Males and Females 
on the Posttest and Delayed Posttest Verbal Scores 
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Posttest 




Posttest 


Delayed 
Posttest 


Group 
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X 


SD 
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SD 
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7 


27.00 


8.52 


24.14 


6.87 


7 


33.86 


4.98 


26.86 


4.06 
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7 


32.25 


8.56 


29.14 


11.33 


8 


26.75 


8.78 


22.00 


10.09 


FR 


7 


32.29 


4.07 


31.14 


6.07 


8 


24.25 


10.04 


21.88 


9.39 


NFR 


8 


27.13 


8.61 


18.63 


9.69 


7 


26.00 


7.85 


26.14 


6.31 



TABLE 4 



Mean Time in Minutes Spent by Ss in Completltig the Prograa 
and Criteria Achievement Testa 
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Fig. 1. Mean acorcn Attained on tha tracing portion of the poctceat and 
the delayed poatteat. 
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Fig, 2» Mean scores attained on the verbal portion of the poittest for 
nala and female 
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Fig. 3. Mean scores attained on the verbal portion of the delayed post- 
test for male and female Ss. 
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